3D Surface Matching with Mutual Information and Riemann Surface Structures
نویسندگان
چکیده
Many medical imaging applications require the computation of dense correspondence vector fields that match one surface with another. Surface-based registration is useful for tracking brain change, registering functional imaging data from multiple subjects, and for creating statistical shape models of anatomy. To avoid the need for a large set of manually-defined landmarks to constrain these surface correspondences, we developed an algorithm to automate the matching of surface features. It extends the mutual information method to automatically match general 3D surfaces (including surfaces with a branching topology). We use diffeomorphic flows to optimally align the Riemann surface structures of two surfaces. First, we use holomorphic 1-forms to induce consistent conformal grids on both surfaces. High genus surfaces are mapped to a set of rectangles in the Euclidean plane, and closed genus-zero surfaces are mapped to the sphere. Next, we compute stable geometric features (mean curvature and the conformal factor) and pull them back as scalar fields onto the 2D parameter domains. Mutual information is used as a cost functional to drive a fluid flow in the parameter domain that optimally aligns these surface features. A diffeomorphic surface-tosurface mapping is then recovered that matches anatomy in 3D. Lastly, we present a spectral method that ensures that the grids induced on the target surface remain conformal when pulled through the correspondence field. Using the chain rule, we express the gradient of the mutual information between surfaces in the conformal basis of the source surface. This finite-dimensional linear space generates all conformal reparameterizations of the surface. Illustrative experiments show the method applied to hippocampal surface registration, a key step in subcortical shape analysis in Alzheimer’s disease and schizophrenia.
منابع مشابه
Automated Surface Matching Using Mutual Information Applied to Riemann Surface Structures
Many medical imaging applications require the computation of dense correspondence vector fields that match one surface with another. To avoid the need for a large set of manually-defined landmarks to constrain these surface correspondences, we developed an algorithm to automate the matching of surface features. It extends the mutual information method to automatically match general 3D surfaces ...
متن کاملConformal Surface Morphing with Applications on Facial Expressions
Morphing is the process of changing one figure into another. Some numerical methods of 3D surface morphing by deformable modeling and conformal mapping are shown in this study. It is well known that there exists a unique Riemann conformal mapping from a simply connected surface into a unit disk by the Riemann mapping theorem. The dilation and relative orientations of the 3D surfaces can be link...
متن کامل3D Surface-to-Structure Translation using Deep Convolutional Networks
Our demonstration shows a system that estimates internal body structures from 3D surface models using deep convolutional neural networks trained on CT (computed tomography) images of the human body. To take pictures of structures inside the body, we need to use a CT scanner or an MRI (Magnetic Resonance Imaging) scanner. However, assuming that the mutual information between outer shape of the b...
متن کاملAlignment of 3D Models to Images Using Region-Based Mutual Information and Neighborhood Extended Gaussian Images
Mutual information has been used for matching and registering 3D models to 2D images. However, in Viola’s original framework [1], surface albedo variance is assumed to be minimal when measuring similarity between 3D models and 2D image data using mutual information. In reality, most objects have textured surfaces with different albedo values across their surfaces, and direct application of this...
متن کاملHuman Brain Mapping with Conformal Geometry and Multivariate Tensor-Based Morphometry
In this paper, we introduce theories and algorithms in conformal geometry, including Riemann surface, harmonic map, holomorphic 1-form, and Ricci flow, which play important roles in computational anatomy. In order to study the deformation of brain surfaces, we introduce the multivariate tensor-based morphometry (MTBM) method for statistical computing. For application, we introduce our system fo...
متن کامل